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Abstract 

A fully online prior learning assessment and recognition (PLAR) tool for 
internationally educated nurses (IENs) was developed and tested by an inter¬ 
professional team at Ryerson University. The tool consisted of two stages: a self- 
assessment component followed by a multiple-choice examination and narrative 
(vignette) evaluation. The purposes of the study were to describe the 
demographic profile of the IEN registered nurse (RN), to develop the benchmark 
responses that demonstrate competency at the entry-to-practice level of the 
typical IEN RN, and to describe the experience of completing an online PLAR 
tool. A mixed-method approach was used. Findings demonstrated that IEN RNs 
who immigrate to Ontario, Canada are of various ages and come from a wide 
spectrum of countries. The PLAR process holds promise for an objective 
assessment of IEN’s eligibility to write the Canadian Registered Nurses 
Examination (CRNE) and to meet a global need. Further testing of the tool 
across a broader sample is required. 
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Background and Context 

In 2005, successful nursing degree completion became a regulatory requirement with the College 
of Nurses of Ontario (CNO) for eligibility to write the Canadian Registered Nurses Examination 
(CRNE), to attain registration, and to practice as a registered nurse (RN) in Ontario. Additionally, 
in lieu of a BScN, an equivalent degree from another jurisdiction or an equivalent combination of 
basic nursing education plus additional education and/or experience may be deemed degree- 
equivalent by the CNO (2006). 

This new requirement poses a challenge to internationally educated nurses (IENs) who seek 
immigration and registration as RNs in Ontario. IENs must provide evidence to the CNO that 
their international nursing diploma or degree education and experience meets equivalence to an 
Ontario baccalaureate nursing degree at the entry-to-practice level. In 2009, there were 3,611 new 
RN members of the CNO and 9.3% of them were IENs, mainly from the United States, the 
Philippines, and India (CNO, 2009). According to Blythe and Baumann (2009, p. 192), “the 
number of IENs resident in Canada is unknown.” IENs are not necessarily coming to Canada to 
practice, and if they come as family members or through the Live-In Caregiver Program, their 
nursing qualifications may not be declared. 

To assist IENs in demonstrating evidence of degree equivalence, an inter-professional team of 
researchers from the Daphne Cockwell School of Nursing and the G. Raymond Chang School of 
Continuing Education at Ryerson University developed and tested a fully online prior learning 
assessment and recognition (PLAR) tool for IENs. This work responds to the need for objective 
and transparent assessments to determine equivalence to baccalaureate nursing education in 
Canada, as per the CNO’s 2006 PLAR Report and Recommendations: A PLAR Model for Nursing 
Baccalaureate Equivalency. 

In 2008, funding from the Ministry of Citizenship and Immigration Ontario supported the team’s 
development and testing of an online, web-based tool, modeled upon the competencies for entry- 
level registered nurse practice (CNO, 2007). The team chose to create an online tool in order to 
meet the need for accessibility to a PLAR process for IENs who may not be geographically 
located in Toronto, Ontario. 

This PLAR tool consists of two stages, which inform IENs of the practice competencies in 
Ontario and of their status vis-a-vis achievement of degree equivalence. The first stage guides 
them through a self-assessment of degree equivalence and helps them to ascertain documents that 
may constitute evidence of degree equivalence. The second stage provides a multiple-choice 
examination and narrative (vignette) evaluations to objectively assess competency level. The first 
stage can be completed off-shore, during the immigration process and prior to arrival in Canada, 
which avoids expensive travel typically associated with prior learning assessments. All elements 
in the PLAR tool are linked to the national competencies by nursing subject matter experts so that 
a comprehensive report of competencies and evidences to support learning can be produced. The 
IEN can submit his/her PLAR report to the CNO for consideration of eligibility to write the 
CRNE. This tool also helps IENs identify any areas where additional education or work 
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experience might be required by highlighting competencies that had not been met by prior 
learning. 

To ensure that this instrument provides fair, objective assessments of degree equivalence for 
IENs, the team conducted a study to test its reliability and validity. This study had three purposes: 
1) to describe the demographic profile of the IEN RN in Ontario; 2) to develop the benchmark 
responses that demonstrate competency at the entry-to-practice level of the typical IEN RN; and 
3) to describe the experience of completing an online PLAR tool. 

Method 

The design was a mixed-method, initiation methodology which met the requirement for broad 
range phenomena and multiple theoretical frameworks to disclose paradoxes (Greene, Caracelli, 
& Graham, 1989). A combination of quantitative and qualitative approaches facilitated the 
exposure of congruent, contradictory, and omitted responses considered salient to demonstrate 
competency at the degree equivalence level. 

Three instruments were used: (a) a demographic survey; (b) the PLAR tool, which included the 
self-assessment inventory of evidences organized by the 104 competency statements and self¬ 
ranking from novice to expert (Benner, 1984), a 60-question multiple-choice examination, 
randomly released from a bank of 172 questions, and eight narrative clinical vignettes and one 
research vignette; and (c) a post-PLAR satisfaction survey with categorical questions to assess 
level of difficulty, ease of use, and technical problems with the online instrument. The analyses 
compare individual and aggregate participant PLAR self-assessment responses to responses 
expected of an RN at the baccalaureate entry-to-practice level. 

The online PLAR tool was created using the entry-to-practice competencies that are organized 
according to the standards of nursing practice identified by the College of Nurses of Ontario 
(2007). Prior to the study, the clinical and academic nurse experts on the team mapped each item 
from the self-assessment inventory, the multiple-choice examination, and the clinical and 
research vignettes to the 104 competency statements via consensus method. 

With input and feedback from faculty experts, the nurse-investigators created a test bank of 172 
multiple-choice questions and corresponding answers for the competencies. Each of the questions 
and corresponding answers were also mapped to respective competencies by the principal 
investigator. Inter-rater reliability across the investigator team was conducted during data 
analysis. 

For each of the eight clinical vignettes and the research vignette, key competency concepts were 
identified. Each concept was mapped to the corresponding competency statement. Then the 
nurse-investigators created the competency-based vignette questions and respective responses to 
reflect the baccalaureate, entry-to-practice level. Consensus method was used for this entire 
process. 
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The following is a sample of one of the clinical vignettes: 

You are working the night shift after being hired a month ago as 
an RN on a busy medical/surgical unit. One of your clients is an 
80-year-old man, two days post-operative from a heart valve 
replacement. You assess his vital signs and observe that he is 
short of breath with labored respirations. He has had no urine 
output since your shift began. He appears more confused than 
when you cared for him previously. You have some ‘give as 
necessary’ orders from the physician, including giving oxygen 
and inserting a Foley catheter if necessary. 

Here is a sample question for this vignette: 

What other assessment findings would be helpful in your 
decision to initiate oxygen therapy? 

The study was conducted between 2008 and 2009. After ethics approval was received from the 
university, participants were recruited from the CNO mailing list of IEN RNs who had 
successfully written the CRNE within the previous two years and had consented to be contacted 
for research purposes. This sample was chosen as a representative of entry-to-practice IEN RNs 
in order to develop benchmark, degree-equivalent responses for the 104 competencies. 

A convenience sampling design was used in this study. The possible sample size was 198. 
Sixteen did not meet study criteria, therefore N was 182 (Table 1). Study participants received 
CDN$250.00 upon completion of the entire tool or a CDN$ 10.00 certificate for a popular coffee 
shop for partial completion. Only nine of the 51 participants completed the entire PLAR tool. The 
main reason for attrition rates was the length of time needed for completion as the tool was 
available for intermittent access over a three-month period. 
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Table 1 

Response Rates for Each Component of the PLAR 


Recruited N 

Actual N 

Response rate 

198 

182 

91% eligible to 
participate 

Participants enrolled in study 

51 

28% 

(51/182) 

Participants completed the 
self-assessment tool 

32 

63% 

(32/51) 

Participants completed the 
multiple-choice examination 

22 

43% 

(22/51) 

Participants completed clinical 
vignettes 

15 

29% 

(15/51) 

Participants completed 
research vignette 

10 

20% 

(10/51) 

Participants completed entire 
PLAR process 

9 

18% 

(9/51) 


Data Analysis 

The investigators mapped the quantitative and qualitative data to all 104 competencies pre- and 
post-study. At the individual level of analysis (n = 9), data were triangulated for each competency 
and demonstrated convergence, divergence, and omission of evidence for degree equivalence. 
The sample size of participants who completed the entire PLAR was inadequate (n = 9) for 
determining benchmarks for 104 competency statements. Therefore, data analysis emphasis was 
at the aggregate level. Aggregate frequency counts were calculated for the self-assessed 
proficiency levels and types of evidences per competency. For the multiple-choice examination, 
investigators compiled descriptive statistics as well as psychometric testing. Then, by consensus, 
they conducted thematic analysis of each of the vignette responses. Codes were analyzed against 
the predetermined key words per competency per vignette for congruence, divergence, and 
omission of evidence. For the post-PLAR satisfaction survey, frequency counts were calculated 
per question. 


Outcomes 

The demographic findings are shown in Table 2. 
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Table 2 

Demographic Findings 



Outcome 

Statistics 

Notes 

1 

Gender 

M 12% F 88% 


2 

Age range 

20-30 19% 

31—45 67% 

46-65 14% 


3 

Participants’ country of origin 

Philippines 17 

India 10 

USA 6 

Iran 3 

Romania 3 

Pakistan 2 

Colombia 2 

China 2 

Nigeria 2 

Jamaica 1 

Korea 1 

Russia 1 

Switzerland 1 


4 

Years of nursing experience 

0-5 years 47% 
6-10 years 22% 
11-25 years 31% 


5 

No. of times CRNE written 

Once 76% 

Twice 12% 

Three times 6% 

Six times 2% 

No answer 4% 

Eight percent of 
participants had taken 
additional courses prior 
to writing the CRNE, 
while 29% had none, 

49% did not respond, 
and 14% answered as 
not applicable. Thirty- 
five percent of 
participants indicated 
that they had 
participated in and 
received support from 
the Centre for 
Internationally Educated 
Nurses: Creating Access 
to Regulated 

Employment (CARE), 
while 65% did not. 
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In the self-assessment the overwhelming majority of participants self-rated as competent or 
proficient on 104 competencies across the five standards (Figure 1). The most frequent evidence 
types cited across all competencies were diploma/degree and performance appraisal. 

The complex process of descriptive analysis, psychometric testing of the multiple-choice 
examination, thematic coding of narrative responses, and remapping of all measures to the 104 
competencies revealed strengths and gaps in instrument capacity to measure degree equivalence 
for each competency statement. 

The aggregate results of the multiple-choice examination indicated results that were comparable 
to a university passing grade (M = 64.15, SD = 8.47). Psychometric testing revealed that 
questions with an item difficulty of less than 0.3 may require rewording. Investigator inter-rater 
reliability on mapping examination questions to competency statements ranged from .1 to 1.0. A 
score of less than 0.6 is inadequate and questions are flagged for rewording in future studies. 
Coding analysis revealed some convergence, divergence, and omission at the individual level of 
analysis; however, data saturation was not reached. The consensus method demonstrated 
confirmability; however, findings were inconclusive due to a small sample size and variation in 
questions per vignette. 

Most participants found the experience challenging, and yet rewarding (Figure 2). They 
generally found the examination and learning experience enjoyable (Figure 3). The majority 
found it easy to use (Figure 4) and had no technical difficulties (Figure 5). 

Conclusion 

IEN RNs who immigrate to Ontario cross the spectrum of countries and ages. This PLAR process 
holds promise for an objective assessment of IEN’s eligibility to write the CRNE and thereby 
meet a global need for the assessment and recognition of international professional credentialing 
in nursing. Implications for future research include an increase in indicators by which to measure 
all 104 competencies. This complex methodology to map triangulated quantitative and qualitative 
data to 104 competency statements requires large sample sizes. Subsequent methodological 
refinement is required to triangulate data findings, per competency, and thereby develop reliable 
and valid benchmarks for each. Replication studies with sample demographics that reflect the 
Canadian mosaic of IENs are required to create generalizable benchmarks for degree equivalence 
for ultimate assessment and recognition of credentials for registration purposes. 

Technology may help bridge the geographic and professional chasms before professionals plan 
emigration as online tools are quite accessible and easy to use, as demonstrated by this study. Off¬ 
shore and pre-migration access may inform international professionals of Canadian credentialing 
requirements for entering the Ontario workforce. An online instrument can guide candidates 
through the creation of a portfolio with evidence to support their self-appraisal and thereby 
provide a more realistic picture of expectations. An IEN online PLAR process may be expanded 


106 



The Development of an Online Instrument for Prior Learning Assessment and Recognition of Internationally Educated Nurses: A 

Pilot Study 

Santa Mina, Eifert, Ireland, Fine, Vaska Micevski, Wojtiuk, Wilson, and Valderrama 


to include other disciplines and professions so that they too may benefit from its accessibility and 
financial affordability. 



Figure 1. Frequency of evidences to support degree equivalence across 104 competency 
statements. 


How was the experience? 



Challenging Critical Difficult Interesting Learning Rewarding Time Unique 
thinking Exp e r ie nc e Consuming 


Figure 2. Experience of IEN RNS in completion of PLAR. 
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What did you enjoy in its completion ? 


Practice 

Vignette, sample 


Exam. 


Learning experience. 


Glimpse how the 
assessments of IEN 

will he 



All 

Fulfilment of being 
able to complete it 

Diversity of material 
Vignettes 

Literature search 


Figure 3. IEN RN enjoyment of PLAR process. 


How helpful / unhelpful were the PLAR 
directions and ease of use? 


Keep both up-to- 
date and 
coordinated 
10% 


Differences 
between written 
instructions and 
website 
10% 



Answers to the 
examination was 
not given 
10 % 


Plar directions were 
very helpful 
70% 


Figure 4. Ease of use of PLAR online tool. 
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Did you experience computer technical 
difficulties when accessing PLAR? 



Figure 5. Helpfulness of PLAR user directions. 
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